DOCUMENT RESUME 



ED 349 947 

AUTHOR 
TITLE 

PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IR 015 678 

Mittag, Kathleen Cage 

Using Computers To Teach the Concepts of the Central 

i^iju t Theorem. _. . _ . 

23 Apr 92 

23p.J Paper presented at the Annual Conference of the 
American Educational Research Association (San 
Francisco, CA, April 20-24, 1992). 
Reports - Research/Technical (143) — 
Speeches/Conference Papers (150) 

MF01/PC01 Plus Postage. 

Calculators; Computer Software; Higher Education; 
Hypermedia; Mathematical Concepts; Mathematical 
Formulas; *Probabil ity; Research Methodology; 
IDENTIFIERS Samplxng; *Statistical Analysis; Worksheets 

IDENTIFIERS ^Central Limit Theorem; '''HyperCard 

ABSTRACT 

statist,'^ • e A piV0tal theo «m which is of critical importance to 

Limit Theorem" (CLT^^The and statistics is the Central 

ineorem ICLT; . The theorem concerns the sampling distribution 
of random samples taken fr.om a population, including popu at on 
distributions that do not have to be normal distributions Tnis Dan .r 
contains a brief history of the CLT; several forms of the * W " 
T Kr «y»f*g. Groeneveld, Rahman, Harnett, Dubewicz and Mar 7 i 11 i 

h a anVcaJc°u at 10^^ ^T"' ^ ^ * «» P^lSS " 2' 
J!".!, " lat 0n ,f nd usin 8 large populations with computer programs 
are included to illustrate concepts of the CLT. A HyperCard stack !nn 
the p rog ram "Resampling Stats" are also demons trated'in the P aper 
The appendixes contain a proof of Form 5 TIT a ™„ * Paper. 
CLT, three examples of the CLT HvoerSrrf a COmp \ ter wo ^sheet on 
C ^ „ I ,^, • * L " e HyperCard, and a computer program 

(Contains 14 references.) (Author/ALF) Program. 



***********************************^ 

■it suppiiea oy t uhS are tne oest that can be made' * 



Central Limit Theorem 



U.S. DEPARTMENT OF EDUCATION 
OH»ce ol Educational Research and Improvement 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

□ This document has been reproduced as 
received Irom the person or organisation 
originating it 

D Minor changes have been made lo improve 
reproduction Quality 



• Points of view or opinions staled m this docu- 
- - -mem ao not necessarily represent othcial - 
OERI position or policy 



'UN 

CO 

Using Computers to Teach the Concepts 
of the Central Limit Theorem 

Kathleen Cage Mittag 
Texas A&M University 77843-4232 



Paper presented at the annual meeting of the American Educational Research 
Lo Association, San Francisco, CA, April 23, 1992. 

^ "PERMISSION TO REPRODUCE THIS 

O MATERIAL HAS BEEN GRANTED BY 

PO _ Kathleen Cage Mittag 

> 9 ■ 

O ^ TO THE EDUCATIONAL RESOURCES 

BEST COPY AVAILABLE ""' 



ABSTRACT 

A pivotal theorem which is of critical importance to statistical inference in probability 
and statistics is the Central Limit Theorem (CLT). The theorem concerns the sampling 
distribution of random samples taken from a population, including population 
distributions that do not have to be normal distributions. This paper contains a brief 
history of the CLT, several forms of the CLT, and a proof of the CLT. Examples, both 
using a small population with hand calculations and using large populations with 
computer programs will be included to illustrate concepts of the CLT. A HyperCard 
stack and the program Resampling Stats will be demonstrated in the paper. 
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A pivotal theorem of critical importance to statistical inference in probability and 
statistics is the Central Limit Theorem (CLT). The theorem concerns the sampling 
distribution of random samples taken from a population, including population 
distributions that do not have to be normal distributions. According to B rig htman( 1986, 
p. 107), the importance of the CLT is If the central limit theorem didn't exist, statistics 
would have little practical use." Emphasizing this point, Brightman (1986, p. 141) 
wrote, "Without it, estimating population parameters from sample statistics - inductive 
inference - would be practically impossible." This paper contains a brief history of the 
CLT, several forms of the CLT, and a proof of the CLT. Examples, both using a small 
population with hand calculations and using large populations with computer 
programs, will be included to illustrate concepts of the CLT. 

HISTORY 

The CLT first appeared in print in 1733 when A. de Moivre derived a special case of 
the theorem. In 1812, P. S. LaPlace gave a general form of the theorem. C. F. Gauss 
also worked with normal distributions using the theorem. In 1901, A. Liapounoff was 
the first to offer a proof of the CLT (Hald, 1962). 

NORMAL PROBABILITY DISTRIBUTION 

A critical concept that must be understood before properties of the CLT can be 
presented is the normal probability distribution. Brightman (1986, p. 107) presents 
three features of the normal probability distribution. These features are: 
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1 . The normal probability histogram is symmetric. The highest point of the 
curve is the mean. The part of the curve to the right of the mean or expected 
value is a mirror image of the part to the left. 

2. As with all continuous probability histograms, the total area underneath the 
curve is equal to 100 percent. 

3. The curve appears to hit the x-axis but it never does. The chance of events 
very far above and below the mean or expected value is, however, very small. 

DIFFERENT FORMS OF THE CLT 

Several forms of the CLT have been presented by various authors. Six forms will 
now be discussed with their headings boing the name of the authors describing the 
forms. 

1. Kreyszig (1970, p. 191). 

Central Limit Theorem. Let Xi, X2, Xa, ... be independent random variables 
that have the same distribution function and therefore the same mean \i and the 
same variance a 2 . Let Yn = X1 + . . . + Xn. Then the random variable 

Z n - (Y n - nw/(cn0-5) 

is "asymptotically normal" with mean 0 and variance 1 , that is, the distribution 
function F n (x) of Z n satisfies the relation 

lim F n (x) = ())(x) = 1/(27t)0.5l. oo e -u2/2 du . 
n-*» 

2. Groeneveld (1979, p. 185) 

The Central Limit Theorem. If Xi , X2 X n are independently and identically 

2 
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. distributed random variables, with common distribution given by the random 
variable X, for which E(X) = \i and Var(X) = a 2 , then 

limP[(X-A')/(a/vn)stl = F z (t) 
n-*» 

for all t, where F z (t) is the cumulative distribution function for the standard 
normal distribution. We say X is asymptotically normally distributed, with mean 
\i and variance c^/n. 

3. Rahman (1968, p. 364) 

If the non-normal population sampled has a finite variance o 2 and n is large, 
then, 

Z = (M-/j)/(a/vn) 

is approximately a unit normal variable. This is one form of a remarkable result 
in statistical theory, which is known generally as the Central Limit Theorem; and 
it is this theorem which, indeed, gives to the normal distribution its unique 
position in statistics. An extension of this result also shows that if a is replaced 

by s then, again for large samples 
t = (M - /J)/(s/vn) 

is approximately a unit normal variable. Hence the tests of significance used 
in the case of sampling from a normal population can also be used 
approximately when the population sampled is non-normal but with finite 
variance. 

3 



6 



4. Harnett (1970, p. 165 & 167). 

The Central Limit Theorem has two forms: 

a. The distribution of the means of random samples taken from a 

population having mean \i and finite variance o 2 approaches the normal 

distribution with mean y and variance o 2 /n as n goes to infinity. 

b. lim (M - p)/(o/vn) = N(0,1). 
n-**o 

5. Dubewicz (1976, p. 149) 

Central Limit Theorem. Let X-|, X2, . . . be independent and identically 
distributed r.v.'s with EX1 = fj and Var(Xi) = > 0 (both finite). Then (for all z, 
-00 < 2 < oo) i as n-><» 

P{[(X1 -//) + ... + (X n - //)]/(Vna) < z} -* [1/V(2rO] e-- 5 y 2 dy 

The proof of this theorem is included in Appendix A. 

6. Marzillier (1990, p. 1" 70 ) 

The Central Limit Theorem 
If all possible samples of size n are drawn from a population with mean = \i and 

standard deviation = a, and M, the sample mean, is calculated for each sample, 
then the frequency distribution of M, thus obtained, has the following three 
properties: 

a. Its mean = [J, the mean of the population. 

b. Its standard deviation = o/Vn, the standard deviation of the population 

divided by the square root of the size of each of the samples. 

4 
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c. It will tend to have a normal distribution, regardless of the shape of the 
population. 

DISCUSSION OF FORM 6 

Form (6) provides a different perspective of the CLT, which would be applicable for 
use in an introductory statistics course. Different notation used in the explanation of 
form (6) will involve the mean of the frequency distribution of M, hm. and the standard 

deviation of the frequency distribution of M, SDm. Considering part (a), it states that 

the mean of all the sample means equals the population mean. This is reasonable if it 
is considered that some of the sample means will be greater than the population mean 
and some of the sample means will be less than the population mean. 

Part (b) states that the standard deviation of M is equal the population standard 
deviation, a, divided by the square root of the sample size, n. 

SDm - oWn 1 

This means that the sample means are less spreadout than the population mean and 
the spreadoutness decreases as sample size increases. For example, if n=9, SDm = 

1/3 of ct and if n=36, SDm = 1/6 of o\ There is a finite correction formula for finite 

population of size N. The formula is 

SDm = (a/Vn) V[(N-n)/(N-1)] 2 

If V[(N-n)/(N-1 j] is close to 1 , then formula 1 and formula 2 are equivalent. 

Moore (1989, p. 417) illustrated the concept that the larger the sample size.n, the 
standard deviations decrease by the vaiue of oWn. The population is an exponential 
distribution with u.=1 and 0=1. 

5 
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FIGURE 1 

Density Curves 




If n=1 , then o=1 ; if n=2, then cr=i hlz\ and if n=1 0, then o=1 /Vl 0. It can be seen in 
Figure 1 that the variability of the x-values actually decreases as n increases. 

Part (c) is the section of the CLT which is referred to most often. Marzillier (1990, p. 
180) illustrated part (c) as follows: 




The thin lines are graphs of the frequency distributions of M. No matter what the 
distribution of the population is, the frequency distribution of M tends to be normal. 
Intuitively, if many samples are taken from a population, then many more of these 
samples will have means close to u. This forms the "bell-shaped" normal curve. 

EXAMPLE 

A very small population will first be used to illustrate concepts of the CLT. Let the 
population be the numbers 2, 3, 4, 7, 9, and 1 1 , then n=6 and o=3.27. Take all the 
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possible samples of size n=3 from the population, then calculate M for each sample. 
There will be 20 possible samples since C(6,3) = (6I)/(3I3I) =20. 



Sample 


Mean 


Sample 


Mean 


2,3,4 


3 


3,4,7 


4.7 


2,3,7 


4 


3,4,9 


5.3 


2,3,9 


4.7 


3,4,11 


6 


2,3,11 


5.3 


3,7,9 


4.3 


2,4,7 


4.3 


3,7,11 


7 


2,4,9 


5 


3,9,11 


7.7 


2,4,11 


5.7 


4,7,9 


6.7 


2,7,9 


6 


4,7,11 


7.3 


2,7,11 


6.7 


4,9,11 


8 


2,9,11 


7.3 


7,9,11 


9 



Using the means of each sample as the data set, then u.M=6. This agrees with part (a) 
of form (6), which stated that |xm ■ H- 
Again using the means as the data set, then SDm = I -46. 
Using formula 1 from form (6), 
SDm = oWn 

= 3.27/V6 
= 1.34 

These two values for SDm are very close and differ because of round-off errors in M 
calculations. 
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To illustrate part (c) from form (6): 

Frequency Distribution of M 



Class f 

3.0-3.9 1 

4.0-4.9 4 

5.0-5.9 4 

6.0-6.9 5 

7.0-7.0 4 

8.0-8.9 1 

9.0-9.9 1 



Histogram of the Population 



1 2345678 9 10 11 



Histogram of Sampling Distribution of M 

























1 2 3 4 5 6 


7 


B 9 10 11 



The histogram of the population definitely is not a normal distribution, but the 
histogram of the sampling distribution of M is approaching a normal distribution. 
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COMPUTER EXAMPLES 

Since the introduction of computers into the classroom, it has become much easier 
to teach statistical concepts. The first computer example will use a HyperCard Stack 
developed by James Lang. HyperCard version 2.0 or later is needed to run this 
program on a Macintosh computer. A sample worksheet (Lang, 1991 ) is included in 
Appendix B. 

Sample printouts, using HyperCard, are included in Appendix C. In Example 1, 
there were 150 samples taken of size n=5 resulting in u.=4.5 and u.m=4.4 and SD=2.87 

and SDm=1.29. Since SDm should equal 2.87/VB, which is 1.28, the results are 

consistent with the CLT. In Example 2, there were 150 samples taken of size n=10 
resulting in u.=4.5 and um=4.5 and SD=2.87 and SDm=0.869. Since SDm should 

equal 2.87/VTo, which is 0.906, the results are also consistent with the CLT. Example 
3 shows the relationship of mean and standard deviation of the sample means 
generated by a computer to the mean and standard deviation of the population. As 
sample size gets larger the mean of the sample means gets closer to the population 
mean, as is expected. 

Another computer program which can be used to demonstrate the CLT is 
Resampling Stats. Monte Carlo simulations, bootstrapping, and randomization 
procedures are used in this language. Both IBM and Macintosh versions are 
available. Simon and Bruce (1991 , p. 3) define resampling as "use of the data, or a 
data-generating mechanism such as a coin or set of cards, to randomly generate 
additional samples, the results of which can be examined." A program, included in 
Appendix D and adapted by Mittag, was used to demonstrate the concepts of the CLT. 
A data set was entered, 100 trials of size 5(10) were taken, the means were 
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calculated, then a histogram of the means was graphed. Also, the mean of the sample 
means was calculated and recorded as D. The results of the histograms and the um 

calculations agree with the concepts of the CLT when the program is run. 



CONCLUSION 

The CLT should be taught in a statistics course because of its vital importance to 
statistical inference. Four primary topics can be emphasized when teaching the CLT. 
These topics are: a. the variability of M; b. the distribution is centered around the 
mean; c. the variance of the distribution gets smaller as sample size gets larger; and 
d. the distribution of M is a normal probability distribution. These points can be taught 
both by hand calculations with small samples and by using computer programs for 
large samples. The PC is such a powerful tool that it should definitely be used to teach 
statistical concepts. Students can see and actively participate in the sampling 
procedure when using HyperCard, and seeing is believing. The computer can 
simulate sample repetitions rapidly, graphically present the results, quickly perform 
calculations, and allows students to think more about the concepts (Groeneveld, 
1 979). The CLT is just one important statistical concept in which computers can be 
utilized in the explanation. 
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APPENDIX A 



The following proof of Form 5 CLT was offered by Dudewicz (1976, p. 149). 



Proof: 



MXr U) + ...+(X<- U) Q) 

Vna 



= 4 >fx, -u) + ...+ (x<-u) 0) 
Vha -\ma 



4%-f/(t) 
Vna 



n , By Theorem 6.1.2 



jj>x< -[i {t/Vha)j n , By Theorem 5.4.12 



iE(Xi-tf t |2E(X 1 t 2 tA 

— vOj- 

1+ 1! Vna + 2! na2 ha 2 



1 - 2 n ^ 



na2 



1 + 



.5t2 + no^/na 2 ) 



n 



e -0.5t t asn-»°° 
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APPENDIX B 

WORKSHEET 
CENTRAL LIMIT THEOREM 



Part I 



Once you have loaded the program, click on Clear so you are beginning with a new screen. 

The population you will be working with is in the box at the lower (eft corner of the > screen^ 
This is a uniform distribution containing one of each value between 10 and 29 Calculate the 
population mean to verify that the mean of this population is 19.5. bnow worn. 



3. 
4. 



-Set speed to slow, n = 5, and sample count = 150. 

Click take sample and watch the computer select 5 items at random from the P°P ulati °" to J* 
in the sample. Record the sample, its mean, and the sampling error below. Recall that the 
sampling error is the difference between the sample mean and the population mean. Notice 
how the mean is added to the stem and leaf diagram. Repeat this two more times (click take 
sample to repeat). 



Sample 1 
1/ 

21 
3/ 
4/ 
5/ 

Mean = 



Sample 2 

1/ 
2/ 
3/ 
4/ 
5/ 

Mean = 



Sample 3 

1/ 

21 

3/ 

4/ 

5/ 

Mean = 



Sampling error 



Sampling error = 



Sampling error 



Now change the speed to medium and take three more samples (click : take ' sample to 
sample). Notice how the items chosen from the population are no longer highlighted but the 
sample is still displayed. Also notice how the means are continually added to the stem ana ieai 
display. Record the three sample means below. 



Sample 4 



Sample 5 



Sample 6 



Mean = 



Mean = 



Mean = 



Sampling error = 



Sampling error = 



Sampling error 



Now change the speed to fast and click take sample to finish the sampling. Notice at this 
speed the samples aren't displayed (but are being taken as before) and the means are entered 
into the stem and leaf display. (Watch the sample count, it will countdown to 0 when 
sampling is complete). 

Describe the shape of your sample mean distribution. (Is it symmetrical? mounded? What is 
the range? What group has the most data ? etc.) 



From James Lang with permission 
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Click on Stats. This shows the mean of the sample means, the standard deviation of the 
sample means, and the percentage of points within 1, 2 and 3 standard deviations of the mean. 
Copy the information for you dam set here. 

mean of .xBars = 

st. dev. of xBars = 



% of the xBars are within 1 standard deviation of the mean. 
% of the xBars are within 2 standard deviations of the mean. 
'% of the xBars are within 3 standard deviations of the mean. 



What percent of the data in a normal distribution can be expected to be found within 1 standard 

deviation of the mean? %, within 2 standard deviations of the mean? 

. % t within 3 standard deviations of the mean? % 

How do the percentages from the computer simulation compare with those expected in a 
normal distribution? 



Part II. Now we will see what effect a larger sample size has. Click on Clear to get a clean 
screen. Set speed to medium, n = 25, and sample count = 150. 

8. Click take sample and watch the computer select 25 items at random from the population to 
be in the sample. Record the sample mean below. Notice how the mean is added to the stem 
and leaf diagram after each sample is selected. Repeat five times (click take sample to 
repeat). 

Sample 1 Sample 2 Sample 3 

Mean = Mean = Mean = 



Sampling error = Sampling error = ' "Sampling error 

Sample 4 Sample 5 Sample 6 
Mean = Mean = Mean = 



Sampling error = Sampling error = Sampling error - 

9. How does the sampling error compare with those in question 4 ? 

10. Now change the speed to fast and click take sample to finish the sampling. Watch as the 
means are entered into the stem and leaf display. (The sample count will countdown to 0 
when sampling is complete). 

Describe the shape of this sample mean distribution. (Is it symmetrical? mounded? What is 
the range? etc.) 



How is the shape of this sample mean distribution different than the one for n = 5? 

What can you conclude about the effect that larger sample size has on the variation of the 
sample means ? 

er|c 17 



11 Click on Stats. This shows the mean of the sample means, the standard deviation of the 
sample means, and the percentage of points within 1, 2-and 3 standard deviations of the mean. 
Copy the information for you data set here. 



mean of xBars = _ 
st. dev. of xBars = 



J7o of the xBars are within 1 standard deviation of the mean. 
1% of ihe xBars are within 2 standard deviations of the mean. 
1% of the xBars are within 3 standard deviations of the mean. 



•What percent of the points in a normal distribution can be expected to be found within 1 

standard deviation of the mean? %, within 2 standard deviations of the mean/ 

%, within 3 standard deviations of the mean? % 

How do the percentages from the computer demonstration compare with those expected in a 
normal distribution? (Is it possible this is a normal distribution?) 



Part III. Now we will compare the results of the computer simulation to the theoretical calculations 
presented in the textbook. 

12. Click on Clear to clear the screen. Set n = 10, the sample count = 150, and choose the last 
speed. Click take sample to sample and then examine the stem and leaf display. Count the 
actual number of means that are less than 17. 

How many? 

What percent of the samples is this? 

13. Note that for the population given here p. = 19.5 ai;d a = 5.916. Suppose n = 10. Calculate (as 
in example 7.9, page 286) the theoretical percentage of samples ihat have a mean less than 17, 

i.e. P(x < 17). Show your work including the sketch. 



P (x < 17) - 

How close is this percent to the actual value calculated above? 
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Part IV. Now we will look ai the relationship of the mean and standard deviation of the sample 
means generated by computer to the mean and standard deviation of the population. 

14. Click on right arrow (-») to go to the next page of the display. Here you are asked to choose a 
sample size and click on circulate to find the mean and standard deviation of the sample 
means. Note the computer is doing the sampling as before but not. showing each sample. 
Complete the following table: 



a 



mean of set of standard deviation of 

sample means set of sample means 



4 
9 
16 
25 

1 5 . How does the mean of the set of sample means appear to be related to the population mean ? 

1 6. How does the standard deviation of the sample means change as n increases ? 

1 7 . According to the Central Limit Theorem, the standard deviation of the sample means is equal to 

Calculate for n = 4, 9, 16 and 25 and compare to the standard deviation of the set of 
Vn Vn . 

sample means found in the table above. Does the computer experiment support the tneoretical 

formula ? 



Click on the left arrow to return to page 1. Before leaving the program, feel free to experiment with 
different values for n and the sample count. 

ParJ V. Reflecting on the experiment. You may answer the following questions at home. 

18. What is a sampling distribution? How is the sampling distribution generated in this exercise? 



19. How does this computer simulation demonstrate the Central Limit Theorem as discussed in 
Chapter 7 of your text? 
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APPENDIX C 



CENTRAL LIMIT THEOREM HYPERCARD 



The purpose of this program is to let you 
watch the sampling process that leads to th< 
sampling distribution for the sample mean. 
You may also compare the results of the 
program to the theoretical statement called 
the Central Limit Theorem. Click on the 
population below that you want to sample. 



Population: 


10,11, ...29 




Population: 


0,1,2, ... ,9 



EXAMPLE 1 



CENTRAL LIMIT THEOREM HYPERCARD 



sample 




n 



mam 
m m © a 
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e 
i 
i 

2 
2 
3 
3 
4 
4 
5 
5 
6 
6 
7 
7 
8 
8 



sample 
count 



0 



take sample 



O sloiu 
O medium 
® fast 



sample mean distribution 



68686 

220240 

888666 

4020042402422420402402404204 

6686868668868668 

4244424444400440400 

8866666666668668666888 

04444240400220444020042 

868666 

0240444242 

688666 

040 



( Quit ) (stats 
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EXAMPLE 2 



CENTRAL LIMIT THEOREM HYPERCARD 



The nurpose of this program is to let you 
watcn the sampling process that leads to the 
sampling distribution for the sample mean. 
You may also compare the results of the 
program to the theoretical statement called 
the Central Limit Theorem. Click on the 
population below that you want to sample. 



/Population: 10,11, ...29 



Population: 0,1, 2, ... ,9 



CENTRAL LIMIT THEOREM HYPERCARD 



sample 



population 



O 



m m m 

lu a m 



n 



[To 



sample 
count 



U LU LU H 
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o 



ft 



take sample 



O sIouj 
O medium 
® fast 



sample mean distribution 



14 

788789 

41443443Z43334 

8688879856979567789 

334003Z103303304233001Z3141120 

6995585776866576899998597955867577 

441341411103111104Z3Z44Z1031 

86555856667 

011 

559 



( Quit ) (stats) (Clear) QE3 
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EXAMPLE 3 



CENTRAL LIMrT THEOREM HYPERCARD 



Enter a sample size.n, below and click calculate. The computer will then take 
500 samples each of size n from the population below. For each sample trie 
mean is then calculated. Then the mean and standard deviation of this set or 
500 sample means is calculated. These values approximate the mean and 
standard deviation of the sampling distribution of the sample mean. 



^1 =4.5 

<T = 2.87228 

m m m 
lu q m 

HI LH LD LH 



n 
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APPENDIX D 



COPV (11 12 13 14 15 16 17 18 19 20) fl 
REPEAT 100 

SAMPLE 10 A OA 

SUM HA AAA 

DIUIDE AAA 10 B 

SCORE B Z 

SUM Z ZZZ 

DIUIDE ZZZ 100 C 

SCORE C 0 
PRINT D 
END 

GRAPH Z 
SORT Z ZZ 

PRINT ZZ^H ^HWrt^UR*' 
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ERIC 



